On Equilibrium Dynamics of Spin-Glass Systems 
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We present a critical analysis of the Sompolinsky theory of equilibrium dynamics. By using the 
spherical 2 + p spin glass model we test the asymptotic static limit of the Sompolinsky solution 
showing that it fails to yield a thermodynamically stable solution. We then present an alternative 
formulation, based on the Crisanti, Horner and Sommers [Z. fur Physik 92, 257 (1993)] dynamical 
solution of the spherical p-spin spin glass model, reproducing a stable static limit that coincides, in 
the case of a one step Replica Symmetry Breaking Ansatz, with the solution at the dynamic free 
energy threshold at which the relaxing system gets stuck off-equilibrium. We formally extend our 
analysis to any number of Replica Symmetry Breakings R. In the limit R — > oo both formulations 
lead to the Parisi anti-parabolic differential equation. This is the special case, though, where no 
dynamic blocking threshold occurs. The new formulation does not contain the additional order 
parameter A of the Sompolinsky theory. 
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I. INTRODUCTION 

In the last years a great deal of work has been devoted 
to the study of the so called off- equilibrium dynamics of 
glassy systems, i.e., the dynamics on time scales large 
enough to discard the initial condition but not to ensure 
equilibrium. This large amount of work has left aside the 
analysis of the equilibrium dynamics, i.e., the dynamics 
which should lead to the static properties derived from 
statistical mechanics. 

When discussing the equilibrium dynamics of spin- 
glass systems, one usually refers to the Sompolinsky 
solution. 1 Sompolinsky assumed that the relaxation dy- 
namics of a spin glass system occurs via a set of large 
relaxation times t x , all of which become infinite in the 
thermodynamic limit, reflecting the hierarchical order 
of free-energy barriers or states of the spin glass phase. 
By incorporating explicitly this assumption into the re- 
laxation dynamics of the Sherrington-Kirkpatrick (SK) 
model 2,3 he was able to construct a consistent mean-field 
dynamical theory that, in the limit of an infinite series of 
relaxation times, is described by two continuous order pa- 
rameters functions: the overlap function q(x), measuring 
the amount of correlation that has not yet decayed, and 
A(x), representing the anomalous contribution to the re- 
sponse function. As in the static calculation the variable 
x can be defined to vary in the interval [0, 1] with x = 1 
corresponding to the shortest (though infinite) time scale 
and x = to the longest. With this definition q(x) is a 
nondecreasing function while A(x) is a non-increasing 
function with boundary condition A(l) = 0. 

In the static limit the Sompolinsky solution, in general, 
does not coincide with the Parisi static solution of the 
Full Replica Symmetry Breaking (FRSB) phase. 4 De Do- 
minicis, Gabay and Orland (DGO) have, indeed, shown 
that the static limit of the Sompolinsky solution can be 
derived from a static calculation with replicas by using a 



replica symmetry breaking (RSB) scheme different from 
Parisi's one. The two schemes, however, coincide in the 
so called Parisi Gauge, i.e. choosing the function A(x) 
such that dA(x)/dx = —xdq(x)/dx. 1 

In this work we reconsider the Sompolinsky solution, 
we show the instability of its static limit and we check the 
validity of an alternative solution, originally proposed by 
Crisanti, Horner and Sommers (CHS), 6 in the context of 
a generic R Replica Symmetry Breaking scenario. 

Our testing bench is the 2 + p-spin interacting spher- 
ical model whose static properties have been studied by 
the authors in previous works. > 8 Such model, for p > 3, 
displays a rich phase diagram that we show in Fig. I. It 
contains a Replica Symmetric (RS) phase (i.e. a phase in 
which the RS Ansatz yields a thermodynamically stable 
solution), a one step Replica Symmetry Breaking (1RSB) 
phase, an infinite steps RSB phase and even a phase con- 
sisting of an infinite, continuous (or full), set of RSBs 
plus an apart step of RSB (we call it 1-FRSB solution) . 
Besides this, it has the further advantage, with respect to 
e.g. the SK or the Ising p-spin models, of being exactly 
solvable in each one of the phases. In the same model it 
is, therefore, possible to analytically check the validity of 
the Sompolinsky solution (and any alternative proposal) 
both in a phase where the thermodynamics is known to 
be 1RSB and in one where it is FRSB. The relaxation 
dynamics for the present model is illustrated in Sec. II. 
There we also solve the equations of motion making use 
of two simple Ansatz (the dynamic analogues of the RS 
Ansatz and of the Sommers Ansatz, respectively). This 
should help to fix notation and concepts and serves as a 
starting point for the subsequent discussion. 

The line of investigation proceeds, then, along the fol- 
lowing steps. 

Sompolinsky solution. Sec. III. 

Reconsidering in detail the derivation of the Som- 
polinsky solution, we observe that, in a Parisi 
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IRSB-stable phase, it tends to a static solution dif- 
ferent from the one of Parisi as the time goes to in- 
finity. This is not dramatic, since there is no reason 
preventing the dynamic limit from being different 
from the thermodynamic solution (corresponding 
to the global minimum of the free energy landscape 
of the system). Indeed, for 1RSB systems, it is a 
well known property that in a quenching procedure 
from high temperature the dynamics gets stuck at 
a threshold free energy level strictly above the equi- 
librium one. 9 

Stability of the Sompolinsky static limit. Sec. IV. 

Always working in the 1RSB phase of the 2 + p 
spherical model and using the DGO formalism, we 
check the stability of the Sompolinsky solution in 
its static limit. We find that it is thcrmodynam- 
ically unstable (details of the proof of the insta- 
bility are reported in Appendix C). We further 
generalize this result to the case of a dynamics de- 
scribed by any finite number R of diverging relax- 
ation times. 10 Eventually, we analyze the R — > oo 
limit in which the Sompolinsky static limit and the 
static Parisi solution coincide, provided one fixes 
the Parisi's gauge, and we address the reasons of 
the qualitative difference with the behavior at fi- 
nite R. 

CHS Solution, static limit and stability. Sec. V. 

We propose an alternative formulation of the equi- 
librium dynamics of spin glass systems, based on 
the CHS dynamical solution of the spherical p-spin 
model. 6 This is a solution apparently similar to 
the Sompolinsky's one, but based on slightly dif- 
ferent assumptions, that, however, turn out to be 
crucial in curing the instability of the latter. As 
well as Sompolinsky's the CHS solution tends, as 
t — > oo, to a solution different from the Parisi one. 
The explicit computation of the solution on the 
IRSB-stable phase of the 2 + p spherical model 
shows that the infinite time limit coincides with 
the corresponding Parisi solution at the threshold 
free energy and that, unlike Sompolinsky's, it is 
marginally stable in that limit. The same formal- 
ism is effective for any number of steps and the limit 
R — > oo is considered as well. Details are reported 
in Appendix D. 

Finally, in the Appendices A and B, we report the 
DGO derivation of the Sompolinsky solution and dis- 
cuss its connection with the Parisi solution in the FRSB 
phase. 



II. THE DYNAMICAL MODEL 

To illustrate the equilibrium dynamics of spin glass 
systems we use the spherical 2+p spin model defined by 
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FIG. 1: Qualitative sketch of the T — J p phase diagram 
of the 2+p spin spherical model with p > 3 in the 
mean field approximation. Four phases are displayed, (i) 
RS/paramagnetic for which the overlap order parameter is 
zero; (ii) IRSB/structural glass- like, where the order param- 
eter is the single overlap q\ ; (iii) FRSB/spin glass whose order 
parameter is a continuous function; (iv) 1+FRSB with an or- 
der parameter consisting in a function q(x) plus a single num- 
ber gi representing the self-overlap and such that qi > q(l). 
The full curves are the static transition lines, whereas the 
dotted ones are the dynamic ones. Notice that dynamic tran- 
sitions are different from static ones only when an apart step 
of RSB occurs. Indeed this happens for the RS/1RSB tran- 
sition, for which the dynamic transition line is rederived in 
the proper dynamic contest in Sec. VB, as well as for the 
1RSB/1-FRSB and FRSB/1-FRSB transitions (in the latter 
case only in a small region, see inset). For p = 3 only the RS 
and the 1RSB phases are present. 



the Hamiltonian 

1,N l.N 
i i<j ii<...<i p 

(1) 

where p is an integer equal or larger than 3 and Ui are TV 
continuous real spin variables which range from — oo to 
+oo subject to the global spherical constraint 

N 

E^ = N - ( 2 ) 

1=1 

The coupling strengths J^.j (s = 2, 3, . . .) are quenched 
independent identically distributed Gaussian variables of 
variance 

KV, )' ! <■><•••<<'«• ( 3 ) 

and mean zero. The scaling with the system size TV en- 
sures an extensive free energy and hence a well defined 



3 



thermodynamic limit N — > oo. Without loosing in gen- 
erality one may take either J 2 or J p equal to 1 since this 
only amounts to a rescaling of the temperature T. Fi- 
nally, the parameter r is a Lagrange multiplier needed to 
impose the spherical constraint. In the following, when 
discussing the FRSB and 1-FRSB phases of the model, 
we implicitly assume p > 3. 

The relaxation dynamics of the model is described by 
the Langevin equation 



(4) 



where /3 _1 = T is the temperature, Tq 1 a microscopic 
time-scale and the noise & (t) a Gaussian variable of zero 
mean and variance 



<&(*)&(*')>« =2Tc 1 5 ij 5(t-t') 



(5) 



which ensures the proper equilibrium distribution. 

In dynamical calculations the quantities of interest are 
product of spins averaged over the thermal noise and dis- 
order. Of particular interest are the local spin correlation 
function 



C(t,t') = {<Ti(t)<Ti(V)) ( 

and the average local response function 



G(t,t') 



Sphi(t') ' 



t > t' 



(6) 



(7) 



where hi(t) is an external magnetic field. 11 

Using the Martin-Siggia-Rose formalism 12 in the path 
integral formulation 13,14 the correlation and response 
functions can be obtained from a generating functional 
for dynamic correlations and response functions. The 
disordered average can be done directly on the generat- 
ing functional without using replicas since the generating 
functional is normalized to one. 15 The calculation is now 
rather standard and we do not report it but give directly 
the results. The interested reader can find more details 
in Refs. [6,16,17]. 

In the thermodynamic limit N — > oo the dynamics re- 
duces to a single-spin self-consistent non-Markovian dy- 
namics described by the equation: 



= A'[C(t,t')]G{t,t') 

= [,i 2 + - 1) c(M7~ 2 ] G(t,t') (ii) 



where 



(12) 



and A' (a;) = dA(x)/dx. 

The correlation and response functions must be evalu- 
ated self-consistcntly from the single-spin dynamics as 

C(t,f) = (*(t)a(t>)), G(t,t') = (13) 

where the average ((• • •)) is over the random noise r](t). 

Since we arc interested in the equilibrium correlation 
and response function we take the initial time to equal to 
— oo so that two-times quantities become function of the 
time difference only (in other words we are in time trans- 
lational invariant regime). 14 To work in Fourier space we 
introduce the transformed functions 



dte iujt C{t), 

-OO 

r+oo 

G(cj) = / dte iut G(t) 
Jo 



(14) 
(15) 



The single-spin equation of motion then reads 

a(u)=G((j)ri(u}) (16) 

where G(u) obeys the Dyson equation 

G~V) = 0r - iT^uj - S(w) 

= GoVJ-SM (17) 

and ri(u)) is a Gaussian variable of zero mean and variance 

(ti(u) r}{w')) = 2tt 5{u) + J) [2T^ + A(w)] (18) 

In the Fourier space the correlation function C(w) is given 

by 



C(w) = (a(w)a(-w)), 



(19) 



where the average is over the noise r?(w). The Fluctuation 
Dissipation Theorem (FDT) 11 



G(t) = -6{t) t C(t) 



r- 1 8 t a(t) = -Pra{t) + f dt 1 E(t, t') a(t') + V (t) (8) is recast ' in Fourier s P ace ' as 

J to 9 



where to is some initial time and r](t) a Gaussian noise 
with zero mean and variance 



C{oj) = -ImG(w) 



(20) 



(21) 



(r 1 (t)r 1 (t'))=2T^S(t-t')+A(t,t'). 



(9) 



The FDT implies that the static susceptibility G(co = 0) 
reads 



The vertex A and the self-energy E of the 2 + p model 
are given by 

A(i, t') = A[C(t, t')\ = Li 2 C(t, t') + fi p C{t, t' f- 1 (10) 



G(uj = 0) = C(t = 0) - C(t -» oo) 



(22) 



This reduces to G(u) = 0) = 1 when the spherical con- 
straint is imposed (C(t = 0) = 1) and the decay to zero 
of C(t) for large times is assumed. 
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A. The "replica symmetric" solution 

Before introducing the Sompolinsky solution we con- 
sider the derivation of the static limit of the dynamics 
assuming the existence of a time persistent contribution 
to the correlation function. We will eventually see [Eqs. 
(35,39)] that, in the limit u> — > (or t — > oo), it leads to 
a static solution equivalent to a replica symmetric (RS) 
one. 

The strategy for constructing the solution in the spin 
glass phase is the following. First one assumes that in 
the spin glass phase the correlation function C (t) decays 
to a finite value 



lim C{t) =q>0. 



(23) 



The parameter q is called the Edwards- Anderson order 
parameter and represents the time-persistent part of the 
correlation. This implies that C(u>) is of the form 



C{u) = C(cu) + 2irq6(iu) 



(24) 



where C{t) — C{t) — q is the finite-time part of C(t), 
decaying to zero as t — > oo. 

For the spherical model the single-spin equation of mo- 
tion (16) is linear and the self-consistent equation for q 
can be easily derived just substituting the equation of 
motion (16) into the definition (19) of C(to) and extract- 
ing the time-persistent part. However, we derive it in the 
following in a more general way. 

Inserting Eq. (24) for the correlation function into the 
definition of the vertex function A(to) one has 



AM = 



/+oo 
dte iut A(t) 
-OO 



= f dte i ^[A[C(t)]-A(q)+A(q)] 

= A(to) + 2irA(q)8(to) (25) 

where A(to) contains only contributions from the finite- 
time part of the correlation function and is, hence, non- 
singular for to — > 0. Starting from this separation, and 
looking at Eq. (18), the noise r](to) can be split into the 
sum of two independent Gaussian noises 



r](u>) = (f)(uj) + z(u>) 



(26) 



where <p(co) is defined by the finite-time part of the vertex 
function: 

0(w')>* = 2tt 6(u) + J) \2T^ + A(w)] (27) 

while z(u>) by the time-persistent part 

(z(to)z(to')) z = 2tt 8{u + u 1 ) A{q)2Ti 5{uj). (28) 

The two noises <f> and z represent, hence, respectively, the 
the "fast" and "slow" parts of the noise r\. 



By definition, q is the remaining part of the correlation 
function once that the correlations induced by the fast 
part of the noise have died out. As a consequence the 
self-consistent equation for q reads 



9 = «">S>, 



(29) 



where (<t)$ = (<t(lj = 0))^ is the static average value of 
a{uj) induced by the noise <j)(to) in presence of a fixed 
static random noise z. 

To solve the equation of motion and find (ct)^ a relation 
between G(oj) and C(to) is needed. Assuming that, as 
in ordinary phase transitions, the effect of an external 
perturbation will die out on finite-time scales, the full 
response function G is related to the finite-time part C 
of C by the FDT 



C(w) = -ImG(w) 



(30) 



which, in turn, implies 



(<f>(w) = ImG-V)- (31) 

tO 

This relation ensures that the noise <p ac ts as a ther- 
mal noise and hence (cr)^ is the magnetization induced 
in thermal equilibrium by the static Gaussian field z, 



m(z) 



SZ°° da a exp [-±G-\lj = 0) a 2 + za 



0) a 2 + za] 



/+^dcrcxp[ 2 
G(u = 0)z 



iG- 1 ' 



to 



(32) 



Since the equation of motion of the spherical 2 + p spin 
glass model is linear in a (to), this result can be also ob- 
tained by averaging directly the equation of motion (16) 
over the noise 4>(tu) and taking the limit lu — > 0. 

Inserting this expression into Eq. (29) and using Eq. 
(28) one ends up with 



q = G(co = 0) 2 A(q). 



(33) 



Eventually, the expression of the static susceptibility can 
be readily obtained with the help of the FDT relation 
(30) and reads 

G(to = 0) = C(t = 0) - C(t -» oo) = 1 - q. (34) 

We, then, end up with the following self-consistent equa- 
tion for q 



A(q) = 



(1-9) S 



(35) 



that coincides with the static RS solution of the spherical 
2+ p spin glass model. 8 

The dynamical stability of this solution requires that 
the to — > limit of the kinetic coefficient, or generalized 
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damping function, T(w), must be non-negative. Its in- 
verse is defined as 

r-VW^-rj'-iAEM (36) 

Inserting the form (24) of the correlation function into 
the definition of the self-energy S(w), and using manip- 
ulations similar to those used for extracting the singular 
part of A(u), we have 

E(w) = E(w)+A'(g)G(a;). (37) 
In the limit uj — > one then obtains 18 

G-\-w)-G- x (w) 



T- 1 (lu = 0) = Iimr- 1 (w)=*Iim 

r o - 1 + ^ImS(o; = 0) 
l-A'(q)G(cJ = 0) 2 ' 



2uj 



(38) 



The numerator describes the decay of the finite-time part 
and is, thus, positive. The requirement T(uj = 0) > 
leads, then, to the condition 

1 - A'{q) G 2 (uj = 0) = 1 - A'(g) (1 - qf > (39) 

In terms of the static replica formalism, the above expres- 
sion exactly coincides with the De Almeida- Thouless 19 
stability condition derived from the stability analysis of 
the RS saddle point. 8 

The replica symmetric solution is unstable everywhere 
in the low temperature phase, thus this solution is correct 
only in the paramagnetic phase up to the critical point 
where T(uj = 0) = 0. Below this point a new solution is 
needed. 



B. The Sommers Solution 

In the previous derivation of the solution the FDT was 
assumed to hold between the full response function G 
and the finite-time part C of the correlation function. 
The failure of the replica symmetric solution to describe 
the relaxation in the spin-glass phase suggests that in this 
phase the presence of a time-persistent part in the corre- 
lation function must reflect itself also in the response to 
an external perturbation with an anomalous contribution 
to the response function. This extra contribution occurs, 
however, only in the static susceptibility, i.e., exactly at 
zero frequency: 



(40) 



where 5^,0 is the Kronecker delta and A is the discon- 
tinuity between the static susceptibility and the uj — > 
limit of the dynamic susceptibility G(uj): 



A = G(u = 0) - lim G(oj). 



(41) 



The static limit of this solution is known as Sommers 
solution. 20,21 As before, the non singular finite-time G of 



the response function is related to the finite-time part G 
of the correlation function by the FDT 



C(w) = -ImG(w). 

UJ 



(42) 



Inserting the expressions (24) and (40) for the correlation 
and response functions into the Dyson equation (17), and 
making use of Eqs. (26) and (37), a straightforward al- 
gebra leads to the following equation of motion 

<t{uj) = G{uj) [<f>(u) + H{uj)] (43) 

where H{u) = H(z) is the effective static noise 

H{uj) = z(oj)+A'(q)A5 UJ . Q a(oj) 

= z(w) + A'(q) A 5 ufi (44) 

In the second expression we used the fact that, because 
of the Kronecker delta <5 w .o, only the part of <j{oj) which 
is nonzero at oj — may contribute to the static field 
H{z). This part is the static magnetization fh(z) = (a)^ 
induced by the static noise z. The product 5^,0 (0)4, is, 
however, ill-defined since it contains the product of the 
functions S(u) and i^o, both having vanishing width. To 
give a meaning to this product one introduces a finite- 
width representation of the Dirac and Kronecker delta 
functions: e: 



lim SJoj) = S(oj) 



lim A e (u) = <L 

e^0 



(45) 



Then 6^,0 {0)4, is defined as the e — > limit of the con- 
volution of S € (oj) and A e (u). 

If the width of A e (w) is much smaller than the one 
of 8 e (oj) then the contribution of (a) 4, to the static field 
H(z) is vanishing, and one gets back the A = solution. 
In the opposite limit, 1 A e (u>) 6 e (u>) —> S(uj) and the full 
magnetization fh(z) — (a)^ contributes to the static field 

The finite-time parts G and C of the response and 
correlation functions are related by the FDT. As a con- 
sequence the fast noise <j> is a thermal noise and, hence, 
(cr)0 is the static thermal equilibrium magnetization in- 
duced by the static field H(z) [as it was in Eq. (32)]: 



m(z) 



G{w 
G{lu 



0)H(z) 



0) y/A{qjz + AA'(q)m(z) (46) 



where we have rescaled the Gaussian noise z to have 
(z 2 ) z = 1. Solving for fh(z) and inserting the result into 
Eq. (29) we obtain the self-consistent equation 



q = 



1 



1 2 



l-A(l-g)A'(g) 



A(«) 



(47) 



where we used the relation G(uj = 0) = C(t = 0) = 1 — q 
following from FDT. 
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The equation for the anomalous term A is obtained 
from the definition of the static susceptibility and reads: 



/ dm(z) 
\ dph 



h=0 



= 1 -q+ A 



(48) 



where h is a static external field. Adding the field h to the 
equation of motion (43) and inserting the resulting fh(z) 
into the above equation we have, after some algebra, 



1 



Q 



l-A(l-g)A'(g) 



q + A 



(49) 



The two self-consistency equations (47, 49) can be rewrit- 
ten in the form 



cm a 




A(«) = 



(1-3 + A)^ 



(50) 



FIG. 2: Schematic form of correlation function with many 
relaxation time-scales. 



from which one readily sees that for A = the solution 
reduces to the replica symmetric solution at criticality: 
T(lu = 0) = [cfr. Eqs. (35) and (39)]. The dynamical 
stability requirement on the damping function T(u> = 
0) > for the Sommers solution is still given by the Eq. 
(39). As a consequence, for any A > the solution has 
a positive r _1 (w = 0). This apparently hints that this 
solution (or, at least, its static limit) is physically stable. 
However, as noted by Hertz, 22 exactly at uj = the time 
persistent part of the response function [Eq. (40)] should 
not change the relative static solution, thus implying a 
negative non-linear susceptibility. We will reconsider this 
point when we will present the study of the static limit 
of the present dynamics in the DGO formalism in Sec. 
IV 



III. THE SOMPOLINSKY SOLUTION 

The Sommers solution assumes that there are only two 
relevant time-scales, a short time-scale related to the 
finite-time part of the motion, and a long time-scale - 
actually infinite in the thermodynamic limit - related to 
the time-persistent part of the motion. This scenario is 
clearly too limitative for the description of the spin-glass 
phase where different time-scales are involved. 

The Sompolinsky solution extends the Sommers solu- 
tion to the case of many different long times-scales, all of 
which diverge in the thermodynamic limit. To be more 
specific one assumes that there are R different relaxation 
times t r , r = 1, . . . , R. As N — > oo all times go to infinity 
with the prescription t r /t s — > oo if r < s. The short-time 
scale relaxation time, which can be identified with t_R+i, 
is proportional to T^ 1 and remains finite for N — > oo. 

In each time interval, or sector, t r+ i <C t <C t r . The 
relaxation process with characteristic times less than t r 
have already relaxed to equilibrium, while those with 



longer (or equal) relaxation times have not relaxed yet. 
For each time interval t r+ \ <C t <C t r we can introduce 
an order parameter 

q r = T r lim C{t), r = 0,...,R (52) 

where the "time ordered limit" T r lim^oo is defined as 
T r lim := lim • • • lim lim lim • • • lim (53) 

The overlap q r measures the time-persistent part of the 
correlation function in the interval [i r +i,i r ], see Fig. 
2. With this definition qa coincides with the Edwards- 
Anderson order parameter previously defined. Moreover, 
we have introduced the additional level r = associated 
with the longest time-scale, i.e., the equilibration time- 
scale, of the model. The overlap q represents, then, the 
asymptotic equilibrium value (that is equal to zero in 
absence of an external magnetic field) . 

The next step is to split away from the full correlation 
and response functions the time-persistent parts as for 
the Sommers solution. The functions C and G, thus, 
are still of the form (24) and (40) with finite-time parts 
related by the FDT (42), but now 1 

R 

q8{uj) -^^2,{q r - q r -i)5 er (u) (54) 

r=0 

and 

R 

A<y h)i o-»-2A r A £p (w) (55) 

r=0 

where A r is the anomalous contribution to the response 
functions, S e (u>) and A e (w) are finite- width representa- 
tions of the Dirac and Kronecker delta functions, and 
e r = l/t r . Here and in the following we use the conven- 
tion that all quantities of negative sub-index are zero. 
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As for the Sommers solution, the noise r)(iv) is decom- 
posed into the sum of a fast (thermal) noise (j) and a slow 
noise z composed by the sum of independent slow noises 
z r of zero mean and variance 

(z r (u) z r (-ui)) r = [A(gv) - A(g r _i)] 5 €r (u). (56) 

From the definition of q r and the fact that the noise z r 
acts as a static noise only up to the time-scale t r , the 
order parameter q r is, thus, given by 



It = (rn 2 r ) z 



r = 0,...,R 



(57) 



where fh r = fh r ({z}) is the static magnetization induced 
at scale r by the slow noise z and the average (• • -) z 
is over all static noises z r . Clearly m r is a function 
of zq, . . . , z r only since all others noises z s with s > r 
have died out. The magnetization rh r can be obtained 
from the magnetization ttlr induced by the noise z on 
the shortest time scale by integrating out the noises z s 
with s = r + 1, . . . , R: 



Yl Dz s m R (z a , . . . , zr) 



(58) 



=r+l 



where Dz s = P(z s )dz s and P(z s ) is the probability dis- 
tribution of z s . 

One then proceeds as in Sec. II, inserting Eqs. (24,40, 
54, 55) for C and G and Eq. (26) for the noise -q(oj) into 
the equation of motion and looking at its static limit in 
order to derive the equations for the thermal equilibrium 
magnetizations. As we have seen in the study of the 
Sommers solution, in this limit one has to deal with the 
products S £r (uj) A €r (u>). Clearly one has 



5 er {oj) A es (uj) ~ 5 er (w) 
S Cr (uj) A Cs (lu) = 



if r < s 
if r > s 



(59) 
(60) 



r the product is 



since e r /e s <C 1 for r < s. Yet, for s 
ill- defined. 

Sompolinsky solves the problem with the assumption 
that for e <C 1 the width of the function S € (w) is much 
smaller than the width of A e (w), 1 and the product goes 
like 



6 e (oj) A e (uj) ~ 5 e (u>), 



e < 1. 



(61) 



With this assumption each level r contributes to the ef- 
fective field H(z) with the full magnetization fh r . As 
a consequence the self-consistent equation for rfiR reads 
[cfr. Eq(46)] 

m R {z} = (l-qR)H({z}) (62) 



K 

H (i z }) = E [^~rz r - K m r ({z})] (63) 

r=0 



where we used the identity G(io = 0) = 1 — qR, we 
rcscalcd the Gaussian variables z r in order to have 
{Zr) r = 1 an( i we defined 



A r = A(q r ) - A(g r _i), A' r = A'(q r )A r 



(64) 



We anticipate that the cause of instability of the static 
limit of the Sompolinsky solution (studied in Sec. IV), 
is hidden right in the conjecture expressed by Eq. (61). 
We will come back to this problem and we will show how 
to overcome it in Sec. V, where we will analyze the CHS 
solution. 

The equation for the anomalous term A r follows di- 
rectly from its definition: A r represents the anomalous 
contribution on scale r to the static susceptibility. The 
total anomalous contribution to the static susceptibility 
from the short-time scale up to scale r is, then, 



j\\Dz s 

s<r 



d(3h r 



1 - qR 



h r =0 



(65) 



where h r is a static external field active up to the tem- 
poral scale labeled by r, so that dfh r /dh s = if r < s. 
The presence of h r just adds the term (3h r to the r con- 
tribution to H{z), in Eq. (63), and this implies 



fU D *> 

s<r 



1 dm r 
/AT dz r 



dm r 

dz r 



1 - 9R - J2 As 



(66) 



since rh r only depends on zo , . . . , z r . 

Eqs. (57, 58, 63) and (66) together with the expression 
(62) for rfiR constitute the Sompolinsky solution for the 
spherical 2 + p spin glass model. The Sommers solution 
is recovered by taking R = 0. 



A. Sompolinsky's functional and explicit solution 
of the 2 + p spherical model 

The Sompolinsky solution can be obtained from the 
Sompolinsky functional, 1 that, for the spherical 2 + p 
spin glass model, reads 



-Pfs 



R 

/3/o(fe)+2$>rA; (67) 
r r R 

I Ii Dz r |E A >r(W) + «) 

r=0 — n 



r=0 



where 



^H) = -(l-q R )H 2 



(68) 



and 



-PMqr) = -g 9{Qr) + Mvr){1 ~ Vr) 



1 

1 - qR 



-log(l- to ) -/3/oo. (69) 
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The function g is such that 

dgjq) 
dq 



= A(q) 



(70) 



and the term is the infinite temperature limit of 
the free energy, whose explicit form is only needed for 
computing thermodynamic quantities. The Sompolinsky 
equations follows from stationarity of /g with respect to 
variations of m r , A r and A r = A(q r ) — A(g r _i). 

For the spherical 2 + p spin glass model equation (58) 
for the local magnetization m r can be explicitly solved. 
After a simple algebra one gets 



+ 



l - qn 



i + (i-«*) e;1,a' s 



that, with Eq. (57), leads to the following equations for 
the order parameter q r with r = 1, . . . , R 



1r-\ 



1 - qn. 



-I 2 



1 + (!-««) Ef= r A' s 



(72) 



and go 



9o 



1 - Qr 



1 + (1 - to) E 



A' 



[A(g )-(/3^) 2 ] (73) 



In the last equation we have added an external field h to 
make qo finite. Finally from Eq. (66) we have 



1 - to - J2 As 



1 - to 



1 + (!-«*) Ef= r A' s 



(74) 



B. Comparison between the Parisi solution and the 
the static limit of the Sompolinsky solution 

The static solution for the spherical 2 + p spin glass 
model within the Parisi i?-RSB scheme, as obtained in 
Ref. [8], consists of the following self-consistency equa- 
tions: 

A(q r ) - A( 9r _i) = 9r ~ gr " 1 , r = l,...,R (75) 

Xr Xr+1 



AO 

A'(g r ) - J- 

Ar+l 



(76) 
(77) 



where 



Xr 



l-to + ^ m «(^-9«-i). r = 0,...,i? (78) 



The quantities < m r < 1 are the RSBs parameters, 
i.e., the sizes of the blocks of the Parisi i?-RSB scheme 



in the continuation from integer to real numbers in the 
limit n — > 0, where n is the total number of replicas. 

The equations yielding the infinite time limit of the 
Sompolinsky solution for the spherical 2 + p spin glass 
model, i.e. Eqs. (72, 73, 74), can be written in the 
equivalent form 



A(q r ) - A(g r _i) 
AM 
A'M 



Qr — Qr-1 

9 : 
r 

AO 

1 



Xr Xr+1 



r=l,...,i? (79) 
(80) 
(81) 



r K r z r (71) where 



Xr = 1 - to 



E 



A, 



r = 0,...,i? 



(82) 



A simple inspection of the two sets of equations re- 
veals that the Sompolinsky solution cannot be reduced 
to the Parisi solution, not even fixing the so called Parisi 
gauge A r = —m r (q r — q r -i)- This implies that, for any 
finite value of R, the Sompolinsky solution differs from 
the Parisi solution. 

When the number of time sectors (or RSBs in the 
static counterpart) is sent to infinite, however, the static 
limit of Sompolinsky solution can be formally reduced to 
the Parisi solution, 1 provided that the gauge dA(x) = 
—xdq(x) is set. The functions dA(x) = A(x)dx and 
q(x) are the limit functions of A r and q r as R — > oo. The 
parameter x € [0, 1] is the continuous limit of the series 
{m r }. 

This is more easily seen by using the replica deriva- 
tion of the Sompolinsky solution introduced by DGO. 23 
By using this approach it can be shown, see Appendix 
A, that the Sompolinsky solution can be derived from 
stationarity with respect to q r and A r of the DGO func- 
tional 

R 

-2/?/<&> = -g{q R ) - AMA r + {I3hf xa 



r=0 



+ \og{\ - q R ) + 



r=0 



q r — q r -i 

Xr 



(83) 



with Xr is given by Eq. (82). We have neglected the term 
/oo, irrelevant to our discussion. 

In the limit R — > oo in the FRSB phase we have q r — 
q r -i — ► dq while A r — ► (dA(q)/dq)dq = A(q)dq. As a 
consequence, the sums can be replaced by integrals and 
the DGO functional for the spherical 2+p model becomes 



-2/3/, 



DGO 



1 r -l 

2 



dqA{q)A(q)-(J3hy dq A(q) 
Jo Jo 

[ q{1) da 
+ ln(l-g(l))- / »i : , , (84) 
Jo J dq'A(q>) 
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where q(l) = liniR^oo qji, and we have extended the def- 
inition of A(g) to the whole interval [0, 1] defining 

A(q) =0 if < q < q a 

(85) 

A(g) = -1 if g(l) < g < 1 

to have a more compact expression. 

The analogous calculation can be performed within the 
Parisi scheme. When the stable phase of the 2 + p model 
is yielded by a FRSB solution, the Parisi functional is 

-20 = f dq x(q) A(q) + (/3 hf [ dq x(q) 

Jo Jo 

do 

+ In (1-9(1))+ / g (86) 

Jo J q dq' x(q') 

where x(q) is the inverse function of q{x). It is easy to 
see that the two functionals, Eqs. (84) and (86), coincide 
in the Parisi gauge A(q) = —x(q). 

The fact that the two solutions differ might not be 
a problem. Indeed, systems whose thermodynamics is 
described by a 1RSB stable phase display the well known 
property of having a dynamic solution - at which the 
system relaxation gets arrested - that is different from 
the static solution. This arrest is due to the presence 
of very many metastable states of infinite lifetime lying 
at a free energy level higher than the one of the global 
minima, selected, instead, by the static solution. 

The apparent paradox of having different solutions at 
finite R but coinciding ones for R — > oo can be solved 
by inspecting the R — > oo limit of the DGO and Parisi 
RSB schemes. It can be shown that for any finite R the 
difference between the Parisi and the DGO-Sompolinsky 
theories is at least of order 0((q r — gy_i) ), which is finite 
for finite R but vanishes as R — > oo. The gauge invariance 
of the Parisi equation for the order parameter q{x) which 
follows from the DGO-Sompolinsky theory just reflects 
the reparametrization invariance of the Parisi equation 
due to the arbitrary definition of the variable x in the 
Parisi scheme. The Parisi Gauge dA(q)/dq = —x(q) is 
the definition of the function x(q) whose q derivative is 
right the probability density of overlaps. 

IV. STABILITY IN THE REPLICA 
FORMALISM 

The results just described rise the question on the va- 
lidity of the Sompolinsky solution. Is it a different but 
yet acceptable solution? This question is better answered 
considering the phase of the spherical 2 + p spin glass 
model where the 1RSB Parisi Ansatz is known to be 
stable. 8 In the 1RSB phase there is only one long time- 
scale, so that the appropriate dynamical solution should 
be given by the Sompolinsky solution with R = 0, i.e., 
the Sommers solution of Sec. II B. There, we have shown 
that, in the dynamic limit for infinite times (i.e. u> — > 0), 



the equation of motion appeared to be well defined. Here, 
we inspect more thoroughly the Sommers solution exactly 
at u> = and we show that it turns out to be unstable 
everywhere in the 1RSB phase. 

The present analysis is carried out in the DGO formal- 
ism (cfr. Appendix A) that, for R = 0, is analogous to 
the Parisi RSB formalism with R=l. Our approach is a 
straightforward generalization of the procedure adopted 
in Ref. [24] to study the stability of the 1RSB solution a 
la Parisi in the spherical p-spin model. 

The replicated free energy density as a function of the 
overlap matrix q reads: 

1 1,n 1 

ab 

g{x) = ^ + bL x P, (88) 
Z p 

where fi p — (f3J p ) 2 p/2 and s(oo) = (1 + ln27r)/2 is the 
entropy per spin at infinite temperature. The parameter 
n is the number of replicas. 

The elements of the symmetric n x n real matrix q are 

1 N 

*»6= j^E ? *' a,b=l,...,n. (89) 

The spherical constraint, Eq. (2), implies that the di- 
agonal elements of the matrix q are all equal to one: 

q aa = q = l- 

The saddle point equation reads, in the n — > limit, 
A(g a /j) + (T 1 )^ = 0, a?/3. (90) 

The stability of the saddle point calculation requires 
that the quadratic form 

5 2 {-pf) = -\ E A'Gfe/j) (5q a pf + ^Mq- 1 Sq) 2 

a/3 

(91) 

must be positive definite. 24 The elements of the symmet- 
ric matrix Sq are the fluctuations Sq a b from the saddle 
point value (90). 

At this stage we impose the Sommers Ansatz in the 
DGO formalism, i.e., we divide the matrix q into n/po x 
n/p blocks of dimension p x p and we set 

q a b = (1 - q)5ab + {q- r)e ab + r (92) 

where the matrix e is defined as 

f 1 if a and b arc in a diagonal block , . 
eab ~ \ otherwise (M) 

The Sommers solution is recovered by sending the block 
size po to infinity with the constraint po{q — r) — > — A. 

Details of the study of the Hessian of Eq. (87) in the 
present Ansatz are reported in Appendix C. Here we con- 
centrate on the results of that analysis relevant for the 
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stability of the DGOr = o Ansatz. We have n/po clusters 
each composed by po replicas. Different kinds of fluctua- 
tions can, thus, occur, e.g. between replicas in the same 
cluster or in different ones, or between clusters taken as 
a whole. In the limit of the number of replicas going 
to zero, the eigenvalues of the replicated Hessian matrix 
that might take negative values are the following. 

1. Fluctuations in the same cluster. 

These are the fluctuations between one replica and 
Po others, belonging to the same cluster. The cor- 
respondent eigenvalue is 



A< 1} - -A'(g) + 



1 



(i-<z) 2 



(94) 



This is the so-called replicon and describes longi- 
tudinal fluctuations in the replica space. It must 
be non-negative in order to ensure thermodynamic 
stability. It is, indeed, always positive for the Som- 
mers solution, as long as —A = A > 0. To see 
this one just uses Eq. (51) to replace A.'(q). A^ 
is the static counterpart of the dynamical stability 
condition T(ui = 0) > of the Sommers solution 
discussed at the end of Sec. II. 

2. Fluctuations between clusters. 

The first dangerous eigenvalue for the Sommers so- 
lution is, instead, 



A, 



(3) 



-A'(r) + 



(1-q+Po (q-r)) 

w = oo -A'(q) + j 1 — x - (95) 

(1 -q — A) 2 

In this case we are considering contributions com- 
ing from fluctuations between clusters as a whole. 
Using Eq. (51), Aq 3 ' turns out to be always nega- 
tive for — A > 0, signaling the instability that we 
were mentioning at the end of section II. 

3. Mixed Fluctuations. 

Another eigenvalue indicating an instability is 



A< 2 > 



-bo -2) 



-Po 



(96) 



q(l-q)+Po (q-r) 2 
{l-q) 2 (l-q+p (q-r)) 

?(i - q) 



(l-g)2(l_ g _A)' 



as po > 1 



It becomes infinitely large and negative as po — * oo. 
A similar problem has been observed recently in the 
study of the stability of the R step DGO saddle 
point of the truncated model. 25 

^From this analysis we can conclude that the Som- 
polinsky theory does not yield a physically consistent 
static limit. 



V. THE DYNAMICAL SOLUTION 

The problem with the Sompolinsky solution follows 
from the assumption that the width of the function S e (u>), 
whose limit for e — ► is a Dirac delta function, is smaller 
than the one of the function A £ (uj), whose limit is, in- 
stead, a Kronecker delta, see Eq. (61). To overcome this 
assumption Hertz 22 proposed a different solution that 
avoids the assumption Eq. (61) by using the representa- 
tions 



A e (w) = 



1 



1 



Im 



iuj 



(97) 
(98) 



Hertz, however, assumes a standard form for the FDT 
and, hence, his solution is valid only at the critical point. 
CHS, studying the dynamics of the spherical p-spin spin 
glass model, propose, instead, a solution reproducing the 
correct static limit in the 1RSB phase. The solution dif- 
fers from the Sommers-Sompolinsky solution and is in 
the same spirit of Hertz, 22,26 though with a different im- 
plementation of the FDT. 

We will first present the CHS solution for the 2+p-spin 
model in the Fourier space for two time sectors and we 
will then generalize it to an arbitrary number of R + 1 
time sectors. The CHS solution was originally developed 
(for the spherical p-spin model) in the time space. The 
generalization of the CHS theory to R time-scales in the 
time space, however, though feasible 27 is quite tedious. 
Therefore, we rather work in the u space. 



A. The CHS Solution 

The CHS solution assumes, in the spirit of multiple- 
scale analysis, that the correlation and response functions 
are function of a fast variable t and a slow variable et, 
e< 1: 



C(t)=>C(t,et), G(t)=> G(t,et) 



(99) 



The fast variable t describes the decay of C to the plateau 
value qi while the slow variable et describes the subse- 
quent decay to the equilibrium value qo, see Fig. 3. 

If we are interested only in the leading order behavior 
for e — > 0, this is equivalent to assume time-scale sepa- 
ration: cither the fast variable is varying while the slow 
variable is zero (i.e. the processes evolving on the long 
time scale are quenched) or the slow variable is varying 
and the fast variable is infinite (i.e. the processes evolving 
on the short time-scale have already thermalizcd). Under 
this assumption the correlation and response function can 
be represented as the sum of two separated contribution 
relative to long and short time dynamics: 28 



C(t) = C\(t) + C (et) 
G(t) = G 1 (t) + eG (et), 



(100) 
(101) 
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C(t) A 




FIG. 3: Schematic form of correlation function with two re- 
laxation time-scales. 



or 

C(w) - Ci(w) + e- 1 C (w/e) (102) 
G(lu) = dH+Go^/e), (103) 

where C\ and G\ describe the fast part and Co and Go the 
slow part of G and G, see Fig 3. Alternatively, one can 
employ the standard technique of multiple scale analysis, 
ending up again at the leading order in e with the above 
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expressions/' 

The functions C\ and Go satisfy the boundary condi- 
tions 



d(t = 0) = Ci(i = oo)=0 



C o (t = 0)=q u G (i = oo) 



9o 



where we used the spherical constraint C(t 
while, as e — > 0, 



and 



Gi 7^ iff t < e" 



Go 7^ iff * > e" 



(104) 

(105) 
0) = 1, 

(106) 
(107) 



In the regime t <C e 1 the FDT must be satisfied and 

hence fast parts Gi and Gi are related by the FDT rela- 
tion 



Gi(w) = -ImGi(w) 



(108) 



In the long-time regime t ^> e _1 the response to an exter- 
nal perturbation is given only by the degrees of freedom 
which have not relaxed, i.e. equilibrated, in the short- 
time regime t <C e~ 1 , and hence only these degrees of free- 
dom contribute to G . On the other hand all degrees of 
freedom contribute to correlation Go- As a consequence 
Go cannot be related to the full Co- If we introduce a 



parameter m, < m < 1, measuring the fraction of de- 
grees of freedom which have not relaxed in the short-time 
regime, we have 



G (u>) = mGo(w) 



(109) 



where Go is the response function which would be ob- 
served in the long time-regime iff all degrees of freedom 
would be still active, i.e. non equilibrated. Since all de- 
grees of freedom contribute to Go this is related to full 
correlation function Go by the FDT 



CoM = -ImGo(w) 

UJ 



(110) 



where Go is Fourier transform of the non-persistent part 
ofC : 



C (t) = C (t) - C (t = oo) = C (t) - q 



(111) 



The equations for m, q\ and go are obtained by study- 
ing the dynamical equation in the static limit u — > and 
e — > in the two regimes uj ^> e and ui <C e. 

The parameter m is related to the discontinuity of 
G(oj) in passing from frequencies w > e to frequencies 
u) < e: 



G(w = 0) - G(wi) = mG o (w = 0) 
= m( qi - q Q ) 



(112) 



where Wi is an infinitesimal frequency, ui\ <C T , but goes 
to zero slower than e: wi 3> e — > 0. In the last line we 
used the identity Gq(lu = 0) = qi — qo which follows from 
FDT relation (110). Inserting now the Dyson equation 
(17) into the l.h.s of the above equation we end up with 

n»(«i-9o) = G(w = 0)G(wi) [E(w = 0)-E(wi)] (113) 

From the expression (11) for the self-energy it follows 

E(w = 0) - E(wi) = 



<ft (1 



A'[C(t)]G!(t) 



+e / dt (1 - e-^ 1 *) A'[C(t)] Go(et) (114) 
Jo 

The first integral vanishes for u>\ <C T , but wi > 6 as 
e — > 0. In the second integral only the region t » e _1 , 
where Go is different from zero, contributes. Therefore, 
we can replace G with Go in the argument of A'[C(t)]. 
Finally, by using the FDT relation (110), the leading 
contribution to E(w = 0) — E(wi) for e — > reads 

roc 

e dtA'[Co(et)]Go(et) = m[A( qi )-A(qo)]. (115) 
Jo 

Inserting this result into Eq. (113) and using the identity 
G(cj = 0) = Gi(w = 0) + G (co = 0) = l-gi+m(gi-gb) 
we end up with the equation 



A(gi) - A(q ) 



(1 - gi)(l - qi +m(q 1 - q )) 



(116) 
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The parameter qo is the time persistent part of C(t) for 
i>e _1 . To study this limit we consider the infinitesimal 
frequency wq < e < T and extract the part of C(uq) 

C(u q ) = (ct(-Wo) o-(wo)) 

= G(-w )G(w ) [2^ 1 + A(w )] (117) 

proportional to 6(uio) for e — > 0. From the form of the 
vertex function A(i) we have, see also Eq. (25), 

/+oo 
die*" ' [A[C (et) + q ] - A(q )] 
-OO 

/+oo 
dte iaJot A(q ) (118) 
-OO 



+ 



Only the second integral contributes to the <S(wo) P ar t 01 
C(wq)- We then obtain the equation 



q = G(uj = 0) 2 A(g ) 



or, equivalently, 
A(«b) 



qa 

(1 - qi +m(q 1 - q )Y 



(119) 



(120) 



Equations (120) and (116) coincide the equation for q\ 
and go as function of m for the spherical 2 + p spin glass 
model obtained from the static replica calculation with 
the Parisi 1RSB scheme, see e.g. Eq. (28) and (29) of 
Rcf. [8]. 



B. Stability of the CHS solution 

The equation for the parameter m follows from the 
dynamical stability condition of the static limit which 
requires that the u> — > limit of the kinetic coefficient 
T(u) has to be non negative (simply a physical require- 
ment). To distinguish the two regimes u » e and u <C e 
we define r _1 (w = 0) as 

r- \w = 0) = lim ^[G- 1 ^) G- 1 (-<»)] (121) 

and use the frequencies u\ and ojo defined previously to 
perform the limit in the two regimes. 

Let us first consider the frequency u> ^> e. In this case 
the limit uj — > must be evaluated as 



lim f(u) := lim lim f(oj) = /(wi) 

uj— >0 u->0 e-»0 



(122) 



Since Go(wi/e) ~ 0, we, thus, have 

G-^wiJ-G-^-wi) - -2«^ 1 [r : 1 +yl 1 (^ 1 )] (123) 

-A'( g i)[Gi(wi)-Gi(-wi)] 

where is a finite and positive quantity. Inserting 

this expression into Eq. (121) we end up with 18 



k l-G!(o; = 0) 2 A'( gi ) 



so that the requirement T(ui) > leads to the condition 

1 - Gi(w = 0) 2 A'(<?i) = 1 - (1 - gi) 2 A( 9l ) > (125) 

A similar calculation for w < £, i.e., evaluating now 
the limit ui — > as 

lim := lim lim f(w) = /(wo) (126) 

w— »0 £— >0u- »0 



leads to 



r (W0) - 1 - G(o; = 0W«,) 



(127) 



where A 2 (w ) is finite and positive. We have, thus, the 
second condition for the stability: 

1 - G(oj = 0) 2 A'(q ) = 

l-(l- qi +m( qi -q )) 2 A{q ) >0 (128) 

The dynamical stability conditions of the static limit, 
Eqs. (125) and (128), coincide with the stability condi- 
tions of the 1RSB saddle point computed in the static 
replica calculation of Ref. [8] [Eqs. (31) and (32)]. 

^From a dynamical point of view, and for the consis- 
tency of the calculation, we must require that r(a>i) = 0. 
Indeed, if r(a>i) > the correlations decay exponentially 
fast and the system equilibrates on a time-scale of order 
r _1 (cji). This would imply that all degrees of freedom 
have relaxed before entering the regime t 3> and 
m = 0, i.e., we have back the RS solution. To yield a two 
time scales solution, then, the condition (125) becomes 
the additional equation: 



l-(l-g 1 ) 2 A( (7l ) = 



(129) 



(124) 



the so called marginal condition. 29 The self-consistency 
equations (116), (120), (129) and the stability condition 
(127) yield the CHS dynamical solution of the spherical 
2 +p model in the 1RSB phase. The dynamic RS/1RSB 
transition line in Fig. I can be obtained right by Eq. 
(129) as the curve where q\ jumps discontinuously from 
zero to a finite value. 

Summing up, the CHS solution presents - in the 1RSB 
phase - an infinite time limit different from the static so- 
lution. Indeed, it coincides with the solution known as 
"dynamic", where the 1RSB phase nucleates at higher 
free energy than the equilibrium one. The stable phase, 
in the sense of lower free energy, in this regime is still the 
RS one but a 1RSB phase exists, is locally stable, and de- 
spite a higher free energy it dominates the dynamics due 
to the very large degeneracy of the metastable states be- 
longing to it. In other words, in its evolution on the free 
energy surface, the system will find itself with probability 
one in a local minimum of the 1RSB solution simply be- 
cause the number of these minima is exponentially large, 
in the system size, with respect to the number of global 
minima of the RS solution. The logarithm of the num- 
ber of equivalent minima is what is called the complexity, 
and hence, the dynamics of the system is dominated by 
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the solution with the largest complexity. The marginal 
condition Eq. (129) is, indeed, nothing else than the con- 
dition of maximal complexity in the static Parisi replica 
theory. 8 The static solution corresponds, instead, to the 
lowest minima of the free energy and has vanishing com- 
plexity This is the reason why the two solutions differ. 
To be more explicit, for the 2 + p-spin model, in Fig. 

1 we noticed two lines between the RS and the 1RSB 
phases. The dotted one is the line at which a 1RSB solu- 
tion (with a qi > 0) arises, even though the statics stays 
RS. This is the dynamic phase transition that, as we have 
just seen above, is also obtained from the static limit of 
the CHS solution. The solid line marks the thermody- 
namic transition to a stable 1RSB phase. In the 1RSB 
region an extensive complexity exists, monotonically in- 
creasing between the lowest equilibrium free energy (at 
which it is zero) and the threshold free energy (where it 
takes its maximum value). The infinite time limit of the 
CHS solution describes those states lying at the threshold 
free energy. 

As Eq. (129) cannot be satisfied anymore with < 
qi < 1 and r(o>i) becomes negative, a different solution 
is needed, involving more time-scales and, correspond- 
ingly, more overlap order parameters. This is right the 
generalization that we are going to analyze in the next 
section. 

In particular, in the T— J p diagram in Fig. I, the limit 
of validity of Eq. (129) is represented by the dynamic 
transition line between the 1RSB and the 1-FRSB phase. 
In that case the number of scales required to stabilize the 
solution out of the region of validity of the 1RSB phase 
(for increasing T at fixed J p or decreasing J p at fixed 
temperature) becomes a continuous set, plus an apart 
step relative to the shortest time-scales. 

We stress that r(a>o) remains non-negative since it de- 
scribes the relaxation of the systems to equilibrium for 
Or 1 . In Appendix D we show in detail why for the 

2 + p spherical model the marginal condition on the in- 
termediate time scale is necessary in order to guarantee 
relaxation to equilibrium on the longest time scale. In 
the 2 + p spherical model the instability appears on the 
intermediate time scale, however, in general, it may ap- 
pear on the longest time scale as well, with a negative 
r(u )- ln the present scenario this means that a new 
(infinite) time-scale enters into the game and must be 
included into the description of the dynamics. 

C. The i?-time-scale CHS Solution 

The extension of the CHS theory to the case of R dif- 
ferent diverging relaxation time scales follows the same 
initial steps of the Sompolinsky solutions, namely one 
introduces R long time-scales, see Fig. 4, 

rV 1 « tR-i « £r-2 « ' ' ' « « e o 1 ( 13 °) 

all of which eventually diverge in the prescribed order 
in the thermodynamic limit. 30 In what follows we shall 



C(t) A 




R-l R-2 R-3 R-4 



FIG. 4: Schematic form of correlation function with many 
relaxation time-scales in CHS theory. 



denote with e the set of the R frequencies e r and assume 
that the limit e — > is always taken in order, i.e., 

lim := lim • • • lim (131) 

A convenient way of studying the dynamics in the limit 
e — > is by using the multiple scale analysis. One then 
assumes that the correlation function C(t), as well as the 
response G(t), is a function of the fast variable tr — 
e^t with e R = Tq and R slow variables r r = e r t (r = 
0, . . . , R — 1) describing the motion in each time sector 

C{t)^C{T R ,T R _ U ...,T U T Q ). (132) 

The leading behavior for e — > in the time sector 
e^ 1 <C t <C e^T-i is obtained by assuming that only pro- 
cesses evolving on times t 3> e" 1 but t <C e~_j contribute 
(i.e. r r = finite) whereas those evolving on slower time 
scales are quenched (r s<r = 0) and those evolving on 
faster time scale are thermalized (r s>r = oo). Under this 
assumption of time scale separation, C(t) can be repre- 
sented as the sum of R + 1 distinct terms 

R 

C(t) = ^CV(r r ), r r = e r t, (133) 

one for each sector. 

The functions C r satisfy the normalization condition 
(spherical constraint) 

R 

C(t = 0) = C r( T r = 0) = 1. (134) 

r=0 

We can now split off the r-sector function C r and take 
the limit e — > with r r finite. Taking the limit r r — » oo, 
afterward, so that C(t) — > q r , cfr. Eq. (52), we have the 
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additional conditions: 

r-l R 

C s (t s = 0) + J2 °s( T s = °°) = 1r Vr = 0, . . . , R 

s—0 s—r 

(135) 

It is useful to define for each sector the non-persistent 
part of the correlation function as 

CV(t) = C r (r) - C r (r = oo ) (136) 

so that the above conditions become 

CV(t = 0) = q r +i — Ir-, C r (r = oo) = Vr = 0, . . . , R 

(137) 

with qn+i = 1, while the whole C(t) reads 

R 

C{t)=^C r {T r )+q . (138) 

r=0 

By similar arguments we obtain the following repre- 
sentation for the response function G(t) 

R 

G(i) = ^e r G r (r r ) (139) 

where each function G r varies only in the correspond- 
ing sector r, where r r ~ 0(1) for e — > 0, and vanishes 
in all sectors with s < r. The function G r represents 
the response of the system to a perturbation in the time 
sector labeled by r, i.e., the response due to all degrees 
of freedom which have not equilibrated in previous sec- 
tors. As a consequence, G r cannot be related to the full 
correlation function C r since all degrees of freedom, equi- 
librated or not, contribute to the latter. By introducing 
the parameter < m r+ i < 1 as the fraction of degrees 
of freedom which have not relaxed up to sector r + 1, and 
hence do contribute to the response in the next sector r, 
we can write 

G r (r) = m r+1 G r (T) (140) 

where G r is the full response in sector r due to all degrees 
of freedom, equilibrated and not: 

C r (w)=-ImG r H (141) 

UJ 

By definition m^+i = 1, since in the first sector all de- 
grees of freedom contribute to the response, while mo = 
since the system equilibrates in the last sector. 

By taking the Fourier transform of Eqs. (138) and 
(139) we have 

R 

C(uj) = Y / e; 1 C r (u r /e r ) + 2irq 6(uj) (142) 

r=0 
R 

G(uj) = Y, G r (u r /e r ). (143) 

r=0 



As for the CHS# = i solution, the equations for q r and 
m r are obtained by studying the static limit u) — > sep- 
arately in each sector. We, then, introduce the set of in- 
finitesimal frequencies w r , with uj r -C e r but co r 3> e r _i, 
all of which go to zero as e — > 0, so that the u — > limit 
in sector r just reads 

lim f(u>) : = lim • • • lim lim lim • • • lim f(u>) 

ejj_i^0 £ r -^l)u-tOe, — 1 eo^O 

= /K) (144) 

The parameter q is the singular part of C(ujo), see 
Eq. (142), and repeating the steps from Eq. (117) to Eq. 
(119) we end up with 

q = G(uJ = 0) 2 A(q Q ). (145) 

where G(ui = 0) must be evaluated from the expression 
(143): 

R 

G(UJ = 0) = Y m r+l °r(u = 0) 
r=0 

R-l 

= 1 - qR + Y "v+i(<?r+i - q r ) 

r=0 
R 

= l-te + ^m r ((7 r -(7 r _i) 

r=0 

= Xo (146) 

[cf. Eq. (78)]. Here we have used the relations G r (cj = 
0) = q r +i — q r , following from the FDT relation (141), 
and mo = 0. Thus we have 

AM = % (147) 

coinciding with Eq. (76) obtained from the static replica 
calculation within the Parisi RSB scheme. The presence 
of an external field h would, indeed, just add a term 
— {j3h) 2 to the r.h.s. of this equation, as can be easily 
verified. 

To find the equation for q r with r = 1, . . . , R, we con- 
sider the discontinuity of G(lo) in passing from one sec- 
tor to the next one: G(o> r _i) — G(u r ). By observing 
that G s (w r /e s ) ~ for s < r (since Lo r /e s » 1) while 
G s (ui r /e s ) — > G s (oj = 0) for s > r (since Lo r /e s <C 1), it 
follows that 

r-l R 

G(u) r ) = ^G s (av/e s ) +^G s (w r /e s ) 

s—0 s—r 
R 

= ^G s (o, = 0) 

s—r 
R 

= ^m s+ i(g s+ i - q s ) (148) 

s—r 

The difference G(u) r -i) — G(u> r ), therefore, reads 

G(u> r -i) — G(u> r ) = m r (q r — q r -\). (149) 
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that, using the Dyson equation (17), can be transformed 
into 

m r (q r — (?r-i) = G{u r ) G(u r -i) [S(w r _i) — S(ov)] . 

(150) 

This relation is valid for r = 1,...,R. For R = 1 it 
reduces Eq. (113) of the CHS solution. 

For the spherical 2 + p model the difference E(w r _i) — 
E(uv) can be easily evaluated: from Eq. (11) and the 
definition of e r we have 

£(oj,._i) — E(w r ) 



^ poo 

V e s / dt (e*"- 1 ' - e 4 ^) A'[C(t)] G s (e s t) 
e r _! / ( e ^r-it _ e iw r tj A'[C(t)] G r _i(e r _ii) 



= / drA'ia-iM+^-ilG^r) 
Jo 

= m r [A(qy) - A(g r _i)] 



(151) 



where we have used the fact that only the term with 
s = r — 1 yields a finite contribution for e — > 0. 

With this expression for the difference S(w r _i) — 
E(w r ), and using the identity [cfr. Eq. (78)] 

R 

G(w r _i) = ^ m s+ iG s (w = 0) 

s— r— 1 

R-l 

s— r— 1 

= 1 - fffl + y^m g (g g - gs-i) 



= Xr 



(152) 



we finally obtain the equation for the static limit of the 
R time scale CHS solution: 

A( gr )-A( gr _ 1 ) = 9r ~ gr - 1 , r = l,...,R (153) 

Xr Xr+1 

coinciding with the result from the static replica calcula- 
tion, see Eq. (75). 



D. Stability of the i?-time CHS solution 

As for the CHS^ = i solution the equation for m r fol- 
lows from the stability condition of the static limit u) — > 
in sector r. From the definition (121) of the kinetic coef- 
ficient T(ui) we have 

r^K) = J-fG-VtO-crV".-)] 

ZiJ r 



To 1 - — [E-HWrJ-S-H-Wr)] 



For the spherical 2 + p model the difference E(uv) — 
E(— w r ) is given by 



E(w r ) — E(— w r ) 



/>OC 

/ d * ( 

Jo 



)A'[C(t)]G(t) 



E(w r ) - E(-w r ) + A'(qr r ) [G(uj r ) - G(-oj r )] 

(155) 



where 



t(w r )= dte^lA'iCit)] - A'(q r )] G(t). (156) 
Jo 



As a consequence we have 



r -l/ \ _ " "day V" 

KH l-G(^A'(g r 



(157) 



The quantity i(d / du> r )t,(ui r ) is real and negative, there- 
fore, the requirement r _1 (w r ) > leads to the dynamical 
stability condition 



1 - G(uj r ) 2 A'(q r ) > 
which can be written [cfr. Eq. (152)] as 



-A'(g r ) + 



Xr+l 



> 



(158) 



(159) 



(154) 



where \r is defined in Eq. (78). We recover then the 
condition for stability of the i?-RSB saddle point in the 
replica calculation. 8 

At difference with the static calculation, however, the 
dynamical solution requires that all r _1 (w r ), but the 
last one for r = 0, vanish. Indeed, as discussed for 
the CHS solution, if it happens that r _1 (w r ) > for 
some r = 1, . . . , R then all degrees of freedom not yet 
thermalized up to sector r relax in the sector r, so that 
m s = for s < r. This, in turn, implies that the number 
of diverging relaxation time scale is r < R, and not R 
as initially assumed. 29 This argument does not apply to 
the last sector r = 0. Indeed, by assumption, the sys- 
tem equilibrates in this sector and this is feasible only if 
r _1 (wo) is positive. 31 

If the above requirements cannot be satisfied and one 
or more T(u) r ) are negative, including the last sector 
r = 0, then additional time scale(s) have to be included 
into the description. This is what happens, e.g., in the 
2 + p spherical model in the 1-FRSB and FRSB phases. 
Actually in these phases an infinite number of successive 
time scales is required in order to stabilize the dynam- 
ics. Nevertheless it can be seen that increasing R the 
violation of dynamical (marginal) stability decreases and 
vanishes as R — > oo. 

We stress that similarly to what happens for the CHS 
solution in the 1RSB phase, also the extension of the 
CHS theory to i?-time-scales does not reproduce exactly 
the same static solution found from the static replica 
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calculation. Indeed, while the equations (147) and (153) 
for q and q r and the condition r(w ) > are the same 
as those found from the static replica calculation, the 
equations 



T(uj r ) = 0, for r = 1, 



,R 



(160) 

differ from the corresponding ones in statics. For any 
finite R we have, thus, the same phenomenon already 
observed for systems described by 1-RSB solution. 32 ' 33 
As in that case, the difference between the static free 
energy and the free energy of the static limit of the dy- 
namical solution corresponds to the existence of an ex- 
tensive complexity of the -R-RSB solution, i.e., to the 
presence of a macroscopic number of statistically equiv- 
alent metastable states dominating the dynamics. In the 
free energy landscape describing the phase space of the 
system, such states are at a free energy level larger then 
the free energy of the static minimum, nevertheless they 
dominate the dynamics due to their macroscopic num- 
ber. In the mean-field picture we are adopting here, for 
e r — > 0, the system is stuck in these threshold states 
because of the consequent decoupling between processes 
at different time scales. Relaxing such constraint, i.e., 
going beyond mean-field, the evolution from the thresh- 
old states at a given step of the RSB can be, instead, 
allowed. 34 

The difference disappears in the FRSB phase where 
the complexity vanishes. Indeed defining m r = x{q r ) 
from cither Eq. (153) or (160) we obtain in the limit 

R — > oo 

(161) 



> - 



(l-qn + f^' dqi x(q'))' 



which is the FRSB solution of the spherical 2+p model, 
cfr. Eq. (53) of Ref. [8]. It is easy to show that in the 
R — > oo limit the order parameter function q(x) satisfies 
the Parisi anti-parabolic differential equation. We also 
note that at difference with the Sompolinsky theory the 
i?-time-scale CHS solution does not introduce the addi- 
tional function A(x). 



VI. SUMMARY AND CONCLUSIONS 

We have addressed the problem of the equilibrium dy- 
namics of spin glass systems. One of the issues that 
makes equilibrium dynamics worth to be studied is its 
connection with the static properties of the systems, i.e., 
those obtained from statistical mechanics via the par- 
tition function. While the statistical mechanics of spin 
glass systems is well developed, the equilibrium dynamics 
is less known. The usual theory for equilibrium dynamics 
of spin glass systems is the Sompolinsky theory that in 
the FRSB phase leads to a static solution in agreement 
with the statistical mechanic one, provided one imposes 
the Parisi gauge dA(x)/dx = —xdq(x)/dx. The Som- 
polinsky theory has received further support from de Do- 
minicis, Gabay and Orland (DGO) who, using a replica 



symmetry breaking scheme with two order parameters 
(a Parisi-likc overlap q and a Sompolinsky-likc anomaly 
A), derived the FRSB Sompolinsky solution from equi- 
librium statistical mechanics. Despite these results the 
Sompolinsky theory was object of criticisms and its va- 
lidity is still not well established. 

In this work we have analyzed in details the Sompolin- 
sky solution using the spherical 2+p spin glass model. 
The main motivations in using this model are (i) that 
its static solution is completely exactly known and (ii) 
that, besides displaying a FRSB phase, it possesses sta- 
ble 1RSB and 1-FRSB phases, so that - unlike in the SK 
model - we can test the Sompolinsky solution in phases 
other than the FRSB. 

The first result of our study is that if the number R 
of relaxation times (equivalently the number of replica 
symmetry breaking steps in the static equivalent DGO 
description) is finite then the Sompolinsky theory leads 
to a static solution that cannot be traced back to the 
static solution obtained with the Parisi RSB scheme. The 
two solutions can coincide only in the FRSB phase, when 
R — > oo and q(x) becomes a continuous function, pro- 
vided one fixes the Parisi gauge. 

To understand the properties of the Sompolinsky so- 
lution we have studied it in the 1RSB phase of the 2+p 
model. The analysis, performed within the equivalent 
DGO theory, reveals that the fluctuations about the 
DGO saddle point yielding the static limit of the Som- 
polinsky solution not only have negative eigenvalues, but 
some of them go to minus infinite. The saddle point is, 
therefore, unstable and the Sompolinsky solution in the 
infinite time limit is not a physically consistent solution. 
As already noted by Hertz 22 the weak point of Sompolin- 
sky theory is in the assumption that each time sector r is 
assumed to contribute to the effective static field H({z}) 
in the spin equation of motion with the full magnetiza- 
tion m r ({z}) induced at that time scale by the slow noise 
z, mathematically expressed by Eq. (61). 

In the second part of the paper we have presented an 
alternative theory for the equilibrium dynamics of spin 
glass systems. The theory, based on the CHS solution 
of the spherical p-spin spin glass model, differs from the 
Sompolinsky theory in that it uses a modified form of the 
FDT theorem to deal with the anomalous contribution to 
the response function, overcoming the Sompolinsky as- 
sumption Eq. (61). In this theory, in the static limit, the 
parameters are q r , the time persistent part of the cor- 
relation function at (infinite) time scale t r , and m r , the 
fraction of non equilibrated degrees of freedom at scale 
t r entering into a modified FDT. No anomaly functions 
are introduced to represent the zero field cooled static 
susceptibility. 

The equations for q r have the same functional form of 
those derived from statistical mechanics using the Parisi 
RSB Ansatz. For any finite R, however, the equations 
for m r have a different form. The reason is that in the 
dynamic theory the equations for m r follow from the con- 
dition that the dumping function must be zero {marginal 
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condition) for all but the longest time scale: 31 
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T(uj r ) = 0, r = 1, 



,R. 



(162) 



In the static replica calculation the self-consistency equa- 
tions for m r are, instead, obtained by the stationarity of 
the replicated free energy functional with respect to vari- 
ation of m r , i.e., from the vanishing of the derivative of 
the replica free energy with respect to m r . From the 
replica calculation point of view, on the contrary, the dy- 
namic marginal condition corresponds to the requirement 
of a maximal derivative of the free replica free energy with 
respect to m r , that is maximal complexity. 6,32 ' 33,35 

The difference between dynamic and static solutions 
is due to the degeneracy of the metastable excited states 
that yields an extensive complexity at free energies higher 
than the static one. Even though their weight is smaller 
than the one of the equilibrium state, the states at higher 
free energy ("threshold states") are statistically much 
more relevant (their number is exponentially larger as 
the size of the system increases) and, therefore, a system 
cooled down from high temperature will end up in one of 
these with probability one. Because of the mean field na- 
ture of the models considered and the consequent growth 
of barriers with the size, the system cannot evolve any- 
more out of the threshold states in a relaxation dynam- 
ics and the equilibrium states become unreachable in the 
thermodynamic limit. This might be possibly bypassed 
considering timescales that are not completely decoupled. 
In our notation it would amount to use non vanishing e 
values and compute the first correction to the leading 
behavior for e — > 0, not an easy task. 

When more RSB steps are considered, the complexity 
depends on more breaking parameters m r and the thresh- 
old value is obtained by maximizing the complexity with 
respect to all of them. In the dynamical formalism it is 
equivalent to impose Eq. (162). This selects the ensemble 
of statistically equivalent minima of the (exponentially) 
more numerous kind, that is, those at higher level in 
the free energy corrugated landscape. As the number of 
steps is increased, the complexity function counting the 
number of minima decreases, as well as the difference be- 
tween the dynamic (threshold) free energy and the static 
(equilibrium) one. 36 In the limit where the stable phase 
is FRSB this difference eventually reduces to zero, as e.g. 
in Ref. [37] for the case of the Ising SK model. The same 
effect can be detected in the Ising p-spin model 38 at zero 
temperature passing from a 1RSB to a 2RSB Ansatz, 
even though both solutions are physically inconsistent 
even at the static point. The advantage of the spher- 
ical 2 + p with respect to the above mentioned models 
is that three apart spin-glass stable phases exist, each 
obtained by a different - physically consistent - RSB so- 
lution, where the above considerations have been tested. 
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APPENDIX A: THE DE DOMINICIS, GABAY, 
ORLAND (DGO) SOLUTION 

In this appendix we sketch the derivation of the De 
Dominicis, Gabay, Orland 23 (DGO) static solution for 
the 2 + p spin glass model and show its relation with the 
Sompolinsky solution. 

In the replica approach the static solution for the 
spherical 2 + p spin glass model is given by the n — > 
limit, where n is the number of replica, of stationary 
point of the replica functional f[Q a b, A a {,]: 24,39 



1,71 



-n, 



/?/[<5a/3,A a/3 ] = ]^^g{Q a f}) - ^^A a/3 Q a/3 
a/3 ab 

+ logTr (T exp I ^^A Q/3 a a 073 + b^<j a J (Al) 

\ a/3 a J 



where Q a p is the spin-overlap matrix in the replica space 
between replicas a and (3, A Q| g, the Lagrange multiplier 
associated with Q a fj and b — (3h the external field. The 
function g(x) is defined as dg(x)/dx — A(x), with A(x) 
given by Eq. (10). Moreover for the spherical model 



A„ 



A 



(A2) 



is the Lagrange multiplier fixing the spherical constraint 
Q aa = 1, and 



/+00 
-OO 



(A3) 



The i?-step DGO solution is obtained by taking the 
n x n matrix Q a p made of {n/po) 2 sub-matrices q a b and 
Tab of size po x po 





( Qab 


Tab 


Tab \ 


Qafj — 


Tab 


q a b 


Tab 




V r ab 


Tab 


Qab / 



(A4) 



with each matrix q a b and r a b an i?-RSB Parisi matrix: 
R+l t-i 



q ab = J2(n-qt-i) n^fc 

t=0 fe=0 
R+l t-1 



Tab =J2( rt ~ r *-!) II <W. 



(A5) 
(A6) 



t=o 



fc=0 
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where 

a k = 0, . . . ,Pk/Pk+i ~ 1 with (A7) 
1 =Pr+i < PR < ■ ■ ■ < Pi < Po, 
5-1 = r_i = 0, 
q R +i — q = 1 (for the spherical constraint) 
= r fl = r. 

The matrix A a p is written in a similar form with the 
Po x po -R-RSB Parisi matrices X a b and p a (,. 

At difference with the Parisi RSB scheme the block 
sizes pk are sent eventually to infinity in order, so that 
Pk/Pk-i — * 0, with the assumption that 

Pk (qk - r k ) — > -A 9fe , p fe (A fe - p fe ) — > -A Afc . (A8) 

as pfc — > oo. The limit n —> is taken at the end. 
As an example we consider 



a/3 



a/3 



R+l 



n^pt [{Xtqt - ptn) - {Xt-iqt-i - (H-m-i)] 
t=o 

n 2 R+1 

+ — y~]pt(ptrt- Pt-m-i) (A9) 



From Eq. (A8) we have r t — qt + A qt /p t + o(l/p t ) and a 
similar expression for p t . As a consequence, performing 
the ordered limit p t — > oo we have 



^ A Q/3 Qq/3 = n 

a/3 



t=o 



(A10) 



The evaluation of the trace is more involved. We shall 
give here the main steps. With the DGO form of A Q( g we 
have 



^2 ^ a pv a vl3 = (A - \r) ^2 a c 



a(3 



R+l 

+ E Pt t( At9t ~~ Ptn "> ~ ( x t-iqt-i - pt-m-i)] 



E E E 



(All) 



i=l oo-..ot-i \af-a,R / 
R / Po N 

E(^-^*-i) E EE <...a„ 



t=0 



a ...at-l \i=l a t ...a R 



where the index i = 1, . . . ,po is relative to the primary 
blocks of size po x p , while the index ak to the sub-blocks 
of the Parisi RSB scheme. 

By inserting this expression into the exponent of the 
exponential in the trace one ends up after a straightfor- 
ward algebra with 




Dz t Y[ f Dy itt 
JJ l[e X p\p R <j> R (HR)}(A12) 



ao...an-i i 



where z t = z(a . . . a t -\) and y i)t = yi(a Q . . . a t -i) are the 
auxiliary Gaussian variables used to linearize the squares 
in (All), and we have used the short-hand notation 



^L e ~ z ^ 2 Dv t 



The function 4>r(H) is defined as 
exp[(j) R (H)} = Tr CT exp 



(A13) 



a 2 +Ha 



2tt 



Xr-X 



exp 



H 2 
2(A«-A) 



(A14) 



while H R is given by 

R 



H R = J2[V^~tZt + ^Kyi,t]+b (A15) 



t=o 



with AX t = A t — Xt-i- In Eq. (A12) we used the fact 
that H R does not depend on a R . 

In the limit p R >• 1 the integral over y ijR can be eval- 
uated at the saddle point 



VuR = \J-^\r m R 



(A16) 



where 



fn R = —MK 



H=H r . 



j>' R (H R ). (A17) 
Noticing that ^J- • •] = 0(n) and n < 1, we then have 

Po „ 

Dz R ]l Dy iiR( ?*+*( H *) = (A18) 

i=l ^ 

|7 exp \p R -\ <j)R-\{H R -{)\ 



where H R _i is given by Eq. (A15) with the replacement 
R-> R-l, while 



1 : 

— L 

2 



^ a \r™r 



4>r-i{H) = J Dz R 

+4> R (,/Xx R ~z R - A Xli m R + if)] .(A19) 

The procedure can be repeated integrating over yi tR -i, 
then over y^ R -2 and so on. After having integrated out 
all yi t we end up with 



algebra with / \ 

( 1 \ Tr g exp I ^y^A a f3a a a/3 + by^a a 1 = exp[n<j>-i(b)] 

T:^2^af)CF a ^P +b^2(7 a \ = \ a/3 a/3 / 

a/3 a/3 / (A20) 
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where 



,. R 1 R 

1(6) = n^[oE A ^t 2 + ^W] (A21) 

t=o t=o 



with 



t=0 



+ 6 



(A22) 



and 



m t = m t (z ,...,z t ) = J Dz t+1 m t+1 (zo,...,z t+ i) 

R 

= / II Dz rm R (z a ,...,z R ) 

J r=t+l 

(A23) 

with fh R (z n7 ■ • ■ , Zfl) defined by Eq. (A17). 
Collecting all terms, and redefining 4> R (H) as 



1 H 2 



2X R -X 



(A24) 



to extract trivial factors, we obtain the Sompolinsky 
functional 1 ' 23 for the spherical 2 + p model 



~0fs = g [di 1 ) ~ 9(Qr) ~ A + X R q R 



(A25) 

t=o t=o 

[]^ -^A At m 2 + ^(i/(z)) 
t=o |_ t=o 

The Sompolinsky solution follows from stationarity of /g 
with respect to variations of fh t , A\ t , AX t — A t — A t _i 
A gt , (74, and A leading to, respectively, 



m r = J Dz r+ i m r+ i 
with fh R = <f>' R (H{z}), 

/R 
Yl Dz t m 2 r 
+ — n 



(A26) 



(A27) 



t=o 



S-EA« = ^r/n^^ (*»> 



Ar-A 



A r = A(g r ) 



(A29) 



and 



A K = A'(q r ) A qr 



(A fl - A)" 1 =l-qn 



(A30) 



(A31) 



that is the spherical constraint. 

By using the stationary equations (A29), (A30) and 
(A31) to eliminate A, X t and A\ t from f$, and changing 
the notation as A\ t — » AJ, A gt — > A t and A At — > A t = 
A(gt) — A(gt-i) it is easy to sec that the functional (A25) 
reduces to the Sompolinsky functional (67). 



APPENDIX B: R -> 00 DGO THEORY 

To compare the DGO theory with the Parisi theory in 
the limit R — > 00 we first eliminate the local magnetiza- 
tion m r using the the stationary equation (A26). For the 
the spherical 2 + p spin glass model the equations can be 
easily solved obtaining 



t=o 



/AA7 6 



where 



F r = A fl - A + A > 



(Bl) 



(B2) 



As a consequence 
R R 



J t=0 t=0 



At ™t 



* AA r R 



R 



EifE^ + ^E^ (B3) 

r=0 r t=r t=0 



and 



ff[Dz t H{{z}f = {\ R -Xf 
J t=o 



^ AAt 



Collecting all terms one finally has 



1 



-/3/dgo = 2 [fW " f(te) - A + A Kte ] 

R R 

-9 E A ^) A ^ -E( A * A ^ +* A A t 

z Lt=o 

1 A A* - Aj_i i i. : I , /' 2tt 



(B4) 



(B5) 



t=o 



1 6 2 1 
1- - loj 

2 i*o 2 " y A/j — A 



which is the more usual form of the DGO functional. 
Again the equations for order parameters follow from sta- 
tionarity of /dgo- It can be checked that by eliminating 
the order parameters At and A\ t and A with the corre- 
sponding stationary equations the DGO functional (B5) 
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reduces to the DGO functional (83) given in the main 
text. 

In the limit R — ► oo, ad assuming that we are in a 
FRSB phase, the DGO functional (B5) of the spherical 
2 + p spin glass model becomes 



-/3/dgo = ^ [g(l)-g(qi)-X + Xm] 



(B6) 



i r 1 

--J dxk[q{x)]A q {x) 
1 f 1 

+ -J dx[X{x)A q (x) + q(x)A x (x) 



F(x) 2 F(0) 
2tt 



^VA, - A 



where A(.t) = d\(x)/dx, Xq — A(0) and 

F(x) = Ai - A+ f dx'Ax(x'). 



(B7) 



The expression (B6) is specific of the spherical 2 + p 
model, however it can be written in the more usual form 
for FRSB phase: 4 - 5 - 39 

-/3/dgo = l[g(i)-g(qi)-x + x m ] 



+ 



I 







dxA[q(x)} A q (x) 

dx [X(x) A q (x) +q(x)A x (x) 



dy 



^2ttA(0) 
2tt 



exp 



2A(0) 



2 8 VAi-A 



where 



</>(z,y) = 



F{x) 



+ 



F(x') 



my) 

(B8) 
(B9) 



is solution of the Parisi anti-parabolic differential equa- 
tion 

4>{x,y) = -^-cj>"{x,y) + ^^(x, !/ f (BIO) 



with the boundary condition 

1 y 2 

0(i.y) = o- 



2 Ai - A 



(Bll) 



As usual a "dot" in the Parisi equation denotes the 
derivative with respect to x while a "prime" the deriva- 
tive with respect to y. 

The Parisi solution is recovered by setting A\ = 
—xX(x), A q = —xq(x), see e.g. Ref [8]. 



APPENDIX C: STABILITY OF THE 
DGO-SOMMERS SOLUTION 

In the DGO_r = o Ansatz the free energy fluctuations in 
the replica space, cfr. Eq. (91), becomes 

S 2 [-(3f(r,q 7 m)} (CI) 

ab 

A 2 ^,„ , 2 , 52 



]T(^ a6 ) 2 + — Tr(e 5qf 



ab 



+C 2 5 1abj + 2AB Tr d Q i d Q 
+2ACJ2 Vq 6g) ab + 2BCJ2 (*« * *flf)„6 



a6 



with 



1 

1-9 


(C2) 


g — r 

(i - g)xi 


(C3) 


r 

Xi 


(C4) 


-«-A 


(C5) 



A = = 
B = 
C -- 



where A = —po(q — r) by definition. The eigenvalue 
equation is 

[A 2 - A'(r)] Sq ab - [A'(q) - A(r)] e o6 <5g o6 (C6) 
+B 2 (e <5 9 e) ab + C 2 ^Qcdj 6q ab 
+AB [(e <5g) ab + (5q e) o6 ] + AC^T (5g ac + 5q bc ) 

C 

+BCj2i(£ Wac + it Sq) bc ]=X6q ab 

c 

The above equation is valid for a ^ b. The diago- 
nal elements Sq aa are all zero because of the spherical 
constraint. In the present Ansatz we have n/po blocks 
each containing p elements. The diagonal blocks con- 
tain g-elements, whereas the off-diagonal ones contain 
r-elements. q is the overlap value of replicas belonging 
to the same cluster, r the overlap between replicas of 
different clusters. The different eigenvalues, solutions of 
Eq. (C6), can be grouped in three different sets each one 
corresponding to a given subspace of the replica space. 
One subspace involves fluctuations of the overlaps of one 
replica with other p replicas (both belonging to the same 
cluster and different clusters). Another one involves fluc- 
tuations of the overlaps of groups of po replicas with other 
Pa replicas. The third one consists in the eigenvalues de- 
termining the stability of the fluctuations between clus- 
ters as a whole (roughly speaking). We look in detail at 
the eigenvalues and at their behavior as n — > 0. 
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Fluctuations of the overlaps of one replica with 
po other replicas 



3. Fluctuations of the overlap of one cluster with 
other clusters 



The first subspace is determined by the condition 

(eSq) ab = Va,6 (C7) 

Two eigenvalues are associated to this subspace. One 
corresponds to fluctuations of the overlap between repli- 
cas in two different clusters (off-diagonal elements), for 
which all diagonal blocks are zero: 

e a b Sq ab = V a, 6 (C8) 

The eigenvalue and its degeneracy are: 

= -A'(r)+A 2 (C9) 
(l) _ n(n-p )(p - l) 2 

The other one controls fluctuations of the g-overlaps, 
i.e. the off-diagonal blocks are zero: 



(1 - e ab )Sq ab = Va,6 
Its expression and its degeneracy are: 

A< 1J = -A'(q) + A 2 
(1) _ n{p - 3) 



(CIO) 
(Cll) 



2. Fluctuations of the overlaps of po replicas with 
other po replicas. 

We now look at the fluctuations in the subspace 

(e5<ze) a6 = Va,6 (C12) 

with (e Sq) ab ^ 0, [Eq. (C8) not satisfied]. 

The first eigenvalue can be addressed as the one related 
to fluctuations between different clusters as a whole, that 
is the subspace given by the further condition 



e ab (e Sq) ab = Va,6 
Eigenvalue and degeneracy are: 



A, 



(2) 



-A'(r)+A 2 + Po AB 



(C13) 



(C14) 



n, 



(2) _ n(n-p Q )(p a - 1) 



Pi 



The second eigenvalue deals with the subspace orthog- 
onal to Eq. (C13), i.e. with fluctuations between replicas 
in the same cluster: 

(1 - e ab ) (e 5q) ab = Vo, b (C15) 

Its form and degeneracy arc: 

Ap> = -A'(q) + A 2 + (po - 2)A(B + C) (C16) 



,(2) 



n(p - 1) 



Here we consider the clusters as single elements and the 
relative fluctuations. The subspace we look at is orthog- 
onal to the first two subspaces and in order to express 
the condition defining it we introduce the cluster matrix 



C 



a/3 



(e 6 <l)ab 



with a e a, b G /3 



(C17) 



a, [3 are cluster indexes. In terms of this matrix one 
identifies a first sub-sub-space associated with purely off- 
diagonal fluctuations (i.e. between different clusters): 







Va 



The eigenvalue and its degeneracy are 



A, 



n, 



- -A'(r) + (A + p Q B) 2 
n(n - 3p ) 
2p 2 



(C18) 

(C19) 
(C20) 



There are, then, other two subspaces (for finite n), 
whose physical meaning is less clear since mixed fluctua- 
tions are involved. 

One subsubspace is determined by the eigenvectors for 
which 



Defining 
U-- 



-A'(r)-A'(q) + 2(A + p B) 2 
-B (2A+p Q B) + W + Z 



v=-wz+ 



w 



(C21) 

(C22) 
(C23) 



-A'(r) + (A + p B) 2 

-A'(q) + (A+ poB) 2 -B (2A + p Q B) + Z 

W=(n- 2 Po ) C (A+ poB) (C24) 
Z = 2(po-l) C (A+p B) (C25) 

the two eigenvalues are 



AS - % 



1± 



-4 



(3) n - po 
Pa 



(C26) 
(C27) 



Po 



The last subspace is set by the eigenvectors orthogonal 
toEq. (C21): 

Y,C aa ^0 ]TC Q(3 ^0 (C28) 

Also in this case there are two different eigenvalues, 
whose expression is identical to Eq (C26) provided that 
U = 2(n - Pa )C(A + poB) + n(n - Po )(C 2 + b 2 ). Their 
degeneracy is 1. 
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APPENDIX D: DYNAMICAL SOLUTION FOR 
THE 2 + p SPHERICAL MODEL 

In this Appendix we show that the CHS dynami- 
cal solution of the spherical 2+p spin glass model re- 
quires marginality of the dynamics in the intermediate 
timescales. To keep the notation simple and to refer to a 
physically well known system, we shall consider the case 
of two time scales, appropriate for the IRSB-type phase. 
With minor changes the derivation can be generalized to 
any number of time scales. 

By inserting the forms (94)- (95) for the correlation and 
response function into the Dyson equation (17) and sep- 
arating out the short time behavior u » e as e — > and 
long time behavior ui = e il as e — > 0, one obtains the 
following equations of motion for Gi(u>) and Gq(O): 



r-— Gi(w)-Ei(o/)Gi(w) = 1 (Dl) 



r + A( qi )-e^j Go(fi) 



(l-gi)So(n) 
-S (fi)G (fi) = (D2) 



where Ei(w) and Eo(f2) are the short and long time part 
of the self-energy E(o>), and 



r = r- A(l) = -A(qi) + 



1 



1-91 



(D3) 



to ensure the correct static limit u ~ > of Eq. (Dl). The 
static limit Q — > of Eq. (D2) gives the equation for q . 

A(q 1 )-A(q ) = (r + A(q 1 ))- q -^f -. (D4) 

l-qi+ m{ qi - q ) 

The parameter r can be eliminated from these equations 
with the help of the spherical constraint 

/+oo J 
^ — C(u>) = 2(l- qi )-r(l- qi ) 2 

+2m(l-q 1 ){q 1 -q Q )A(q 1 ) 
-m (r + (1 - m)A(gi)) (qi - q Q ) 2 
= 1 (D5) 

One, then, recovers Eqs. (116,120) of the main text. 



The equations for the correlation functions C\ and Co 
are obtained from Eqs. (Dl), (D2) by using the relations: 



Gi(w) = / dte^dit) 

Jo 

= (1 - qi) + iwCi(w) 



(D6) 



G (co) 



m(l - qi) + m iuj I dte lLJt {C (t) - q ) 
Jo 

m(qi - qo) +m iuC Q (uj) (D7) 



and 



Ei(w) = A(l)-A(«i) 



+tw / die^^AIGr^+^-A^r)) 



A(l) - A(gi) +iwAi(w) 



(D8) 



E (w) = m(A( 9 i) - A(gr )) 

/■OG 

+m iw / <fte <wt (A[C (t)] - A(g )) 
Jo 

= m(A(l) - A(gi)) +m iwAo(w) 



(D9) 



that follows from FDT. A simple algebra leads to the 
equations 



r + A(gi)-^JCi(w) - Ai(w)Gi(w) 

- ^(l- gi )=0(D10) 
1 o 



and 



e 

fo" 



9i - go + iOGo(fi) 

+ [r + A(gi) - m(A(gi) - A(«,))] 
-(l- g i)Ao(n)-Ao(fi)G (n) = (Dll) 



To study the stability of the static limits it is useful to 
rewrite these equation in the time space in the following 
equivalent form: 



r - 1 9 t G 1 (i)+ [r 1 [C 1 (t)+q 1 ]-r](l-q 1 -C 1 (t)) + [ dt'[A[C 1 (t-t') + q 1 }-A[C 1 (t)+q 1 ]]d t ,C 1 (t')=0 (D12) 

Jo 

eTo 1 d t C (t)+[f [C {t),m]-r][l-q 1 +m(q 1 -C (t))]+m f dt'[A[C {t - t')] - A[C (t)]]d t ,C (t') = 6 (D13) 

Jo 



where 5 — lim t ^ + er o 1 d t C (t) and r\{q) and r (q, m) are the functions 



r 1 (q) = -A(q) + 



l-q 



(D14) 
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f,(q) 



f (q,m) 



0.5 : 



% 



0.6 



FIG. 5: Schematic form of fi(q) and fo(q,m) in the 1RSB 
phase. The horizontal line shows the value of r. In the plot 
the slope of fi(q) at qi is strictly positive, implying that the 
slope of ro(q, m) at go (the largest solution of the equation 
ro(<7, m) — f below qi) cannot be positive. 




FIG. 6: Schematic form of ri(q) and ro(q, m) in the 1RSB 
phase. The horizontal line shows the value of r. Here the 
slope of f i (q) at qi is zero, implying a positive slope of the 
function fo(q, m) at q a . 



r (q,m) = r^q) 



(1 - m)(q 1 - q) 2 



(1 -q)[l- qi + m( qi -q)Y 

(D15) 



In terms of these equations the physical values of q\ , go 
(0 < qo < qi < 1) yielding the plateau are the largest 
solution of the equation 6 



r\(qi) = r {q ,m) = r 



(D16) 



with r fixed by the spherical constraint. 

Expanding equations (D12), (D13) near the plateau to 
the first order in the deviation one obtains the dynamic 
stability conditions 



dq- riiq) 



d_ 

dq 



> 



r {q,m) 



=91 



> 



(D17) 
(D18) 



It is easy to check that these coincide with dynamical 
stability conditions (125), (128) given in the main text. 

In the 1RSB phase r\(q) and ro(q,m) have the shape 
depicted in Figs. 5 and 6, while r < l. 6 A simple analysis 
of these figures shows that in order to satisfy Eq. (D18) 
have (d/dq)ro(qo,m) > it is necessary that 



d_ 

dq 



ri(q) 



(D19) 



i.e., the solution at shorter time scales must be marginally 
stable. 
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